Bhagat et al.

Researchers trained a neural network that performs computation in superposition (CiS), implementing more nonlinear functions than it has neurons, by using L⁴ loss instead of standard loss. The model e…